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Abstract —We consider a class of Iq -regularized linear- 
quadratic (LQ) optimal control problems. This class of prob¬ 
lems is obtained by augmenting a penalizing sparsity measure 
to the cost objective of the standard linear-quadratic regulator 
(LQR) problem in order to promote sparsity pattern of the 
state feedback controller. This class of problems is generally 
NP hard and computationally intractable. First, we apply a t\- 
relaxation and consider the l \-regularized LQ version of this 
class of problems, which is still nonconvex. Then, we convexify 
the resulting l \-regularized LQ problem by applying affine 
approximation techniques. An iterative algorithm is proposed 
to solve the h -regularized LQ problem using a series of 
convexified l \-regularized LQ problems. By means of several 
numerical experiments, we show that our proposed algorithm is 
comparable to the existing algorithms in the literature, and in 
some cases it even returns solutions with superior performance 
and sparsity pattern. 

I. INTRODUCTION 

The area of distributed control systems has been growing 
rapidly in the past decade and it has been applied to 
various real-world problems such as formation control of au¬ 
tonomous vehicles, power networks, transportation networks, 
mobile wireless networks, only to name a few. In several 
important applications, the centralized control methodologies 
cannot be applied due to the lack of access to global 
information in subsystem level throughout the network. This 
design constraint has been motivated researchers to consider 
the possibility of designing near-optimal sparse feedback 
controllers for large-scale dynamical networks [1], [2], 

In this paper, we consider a class of (o-regularized linear- 
quadratic (LQ) optimal control problems. This class of prob¬ 
lems can be formulated by considering the standard linear- 
quadratic regulator (LQR) problem and augmenting it with 
an additional term in the cost objective in order to promote 
sparsity pattern of the state feedback controller. This class of 
^-regularized LQ problems is generally nonconvex and com¬ 
putationally intractable. This is basically due to the presence 
of fo-measure in the cost objective and nonlinear terms in 
the Lyapunov equation that corresponds to the closed-loop 
stability of the system. The nonconvex sparsity-promoting 
term in the cost objective can be convexified by replacing 
it with £| -norm [3] in order to relax the problem as a l\- 
regularized LQ problem. This is still a nonconvex problem. 
Our main contributions in this paper are twofold. First, we 
convexify the l\ -regularized LQ problem by applying affine 
approximation techniques to convexify the nonlinear terms in 
the corresponding Lyapunov equation. Second, we propose 
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an iterative algorithm to solve the l\ -regularized LQ problem 
using a series of convexified -regularized LQ problems. 
In the literature review, we discuss that our results are 
close in spirit to [4]. In the numerical experiments section, 
we analyze the performance of our proposed algorithm by 
means of several simulations and compare our results to 
the algorithm proposed in [2]. Our simulation results reveal 
that our proposed algorithm is comparable to the existing 
algorithms in the literature, and in some cases it even returns 
solutions with superior performance and sparsity pattern. 

Some works have been done in order to tract problems 
similar to sparsity-promoting LQR problem. One of the main 
ideas has been the change of Co-norm with convex /j -norm 
and then solving the penalized problem with ADMM method 
[1], [2]. Another method which has been used to get some 
bounds on the optimal value of such sparsity-constrained 
problems works based on projection and gives some useful 
intuition about optimal value of the corresponding sparsity- 
constrained problem [5]. All the methods mentioned so far 
(except the [4]), have been proposed for the continuous-time 
sparsity-promoting state feedback gain controller. In addition 
to such continuous-time state feedback gain controllers, some 
methods have been presented by considering the discrete¬ 
time standard LQR problem which some of them propose 
sparsity-promoting state feedback gain controllers [6], [7], 
[4], [8],[9] and [10]. In one of these recent methods, decen¬ 
tralized state feedback gain controller is presented by using 
some convex relaxations where some graph theoretic proofs 
are provided to determine the upper bound for rank of such 
a relaxed SDP solution and if such a rank is equal to 1, 
then the globally optimal solution can be reconstructed from 
the relaxed SDP solution [7] and [8]. However, the solution 
obtained by such a relaxation-based method is decentralized 
and is not presented for general sparse controllers. But, it 
is spanning both finite and infinite horizon discrete-time 
sparsity-promoting LQR problems [7] and [8]. 

Recently, a method has been revealed which yields sub- 
optimal structured and sparse feedback gains on the basis 
of iterative convex programming [4]. In such a method, the 
objective function of optimization problem has an TQ-norm 
form. Then, the non-convexity of problem is extracted as an 
inversion of an optimization variable. After that, the equality 
condition having such a non-convexity is replaced by two 
complementary inequalities. One of them is characterized 
by Schur complement and the other one is rewritten as an 
equality having some penalized term [11]. It should be noted 
that the non-convex part appeared on such an equality is 
linearized around an optimal estimate. The achieved results 
are really notable in comparison with the simplicity of the 



used iterative convex programming. However, no conver¬ 
gence proof is presented [4]. In [10] as well as [4], convex 
optimization has been used as an effective tool to design a 
sub-optimal sparse static output feedback controller. 

One of the well-known systems studied in Control Theory 
is spatially decaying systems which has been discussed in 
recent years [12], [13], [14], [15], In these recent works, 
a large class of spatially decaying systems is classified 
where their quadratically-optimal feedback controllers inherit 
spatial decay property from the dynamics of the underlying 
system. Moreover, they propose a method based on new 
notions of y-Banach algebras where sparsity and spatial 
localization features of spatially decaying systems can be 
studied when q is chosen sufficiently small. In this paper, in 
first subsection of numerical examples, we employ such a 
class of systems for verifying our proposed design method. 
The results are considerably consistent with our expectations. 
The state feedback gain controllers have patterns very similar 
to the structure of the underlying spatially decaying systems 
with reasonable sparsification. 

Another class of spatially distributed systems is cyclic sys¬ 
tems which arises in biochemical reactions. Such a class of 
systems have been investigated mathematically in [16], [17], 
[18], [19], [20], [21]. The second subsection of numerical 
examples is devoted to considering such well-known systems 
and their sub-optimal sparse controllers design. Also, we 
state how the sub-optimal sparsest solution for such a special 
case can be derived analytically. The interesting fact about 
such a sub-optimal sparsest solution is that it just has 1 
nonzero term. 

This paper is organized as follows: Section [I] is an In¬ 
troduction to the Distributed Optimal Sparse Controllers, 
our main contributions and diverse methods proposed to 
design such controllers. Section |U] is devoted to formulate 
the ^-regularized LQR design problem. In Section III we 


see the main part of the paper which shows how /:j -norm, 
affine approximation and Schur complement help us to cast 
the l \-regularized LQR problem as a simple convex SDP 
form which is solved with CVX toolbox [22]. Section [TV] 
contains the proposed algorithm which finds the sub-optimal 
sparse state feedback gain controller. Section [V] gives some 
numerical experiments of spatially decaying systems and 
cyclic systems which show how useful the new Affine 


Approximation-based formulation presented in Section III 


is. Finally, Section VI concludes the paper together with 
mentioning some future work at the end of it. 


II. Problem Formulation 
We consider the class of linear time-invariant systems 

x = Ax + Bu with a;(0) = xq, (1) 

where A £ R rax " and B £ R nxrra . It is assumed that the 
pair (A, B) is controllable and the initial condition Xq 
is drawn from a standard normal distribution (i.e., with 
zero mean and unit standard deviation). Let us define the 
following f'o-regularized Linear-Quadratic (LQ) optimal 
control problem: 


£ 0 -Regularized LQ (£ 0 -RLQ) Problem: 


Minimize E 

x.u.K 


j (x T Qx + u T Ru)dt\ + a\\\K\\z 0 


subject to: 


x = Ax + Bu, 


u = Kx, 
z(0) = x 0 , 

K : stabilizing. 


In this formulation, K £ R m x " is the state feedback gain 
matrix, R >~ 0 is the control weight matrix, Q A 0 is the 
state weight matrix, and ||A'||^ 0 is the number of nonzero 
elements of matrix K [23]. The 4)-RLQ problem can 
be viewed as a penalized standard LQR problem, where 
the penalty term 11 ivT 11 is augmented to improve sparsity 
pattern of the state feedback gain I\. 

By incorporating constraints of fo-RLQ problem, we can 
cast the objective functional in this problem in a simpler 
form using the following standard procedure 

/» oo />00 

/ (x t Qx + u T Ru)dt = / Tr (x T (Q + K T RK)x)dt. 

Jo Jo 

Tr (x%e {A+BK)Tt (Q + K T RIQe (A+BK)t x 0 )dt 

= Tr(X 0 X), (2) 

where Xq = xqx b and 
/>00 

X = I e {A+BK)Tt (Q + K T RK)e (A+BK)t dt. 

Jo 

In order to satisfy the last constraint in f 0 -RLQ problem, we 
apply the standard Lyapunov theorem and conclude that K 
is stabilizing if and only if X is the unique positive definite 
solution of the following Lyapunov equation [24] 

(A + BK) T X + X(A + BK) +Q + K T RK = 0. 

In the final step, by taking expectation from the equivalent 
cost Q it follows that E{Tt(XoRl)} = Tr(X). This can be 
done as trace is a linear operator and the expectation operator 
distributes over it. As a result of our simplifications, £o-RLQ 
problem can be rewritten in the following compact form: 



Equivalent Form of the £ 0 -RLQ Problem: 

Minimize TrQY) + aqH-Kjl^, (3) 

subject to: 

(A + BK) t X + X(A + BK) + Q + K T RK = 0, (4) 
X A 0. (5) 


The equivalent form of the £o-RLQ problem is in general an 
NP-hard problem and computationally intractable. This is 
due to the fy-sparsity measure in the cost function (|3j. The 
fo-RLQ problem can be relaxed by replacing the /'o-sparsity 









measure with its best convex approximation, i.e., t \ -norm [3] 
in order to get the following relaxed optimal control problem: 

£ 1 -Regularized LQ (fi-REQ) Problem: 

Minimize Tr(X) + ai||iv ||^ 1 ( 6 ) 

X,K 

subject to: 

(A + BK) t X + X(A + BK) + Q + K T RK = 0, (7) 
X ^ 0. ( 8 ) 


The t\ -RLQ problem is still nonconvex due to nonlinear 
constraint 0 - This constraint has differentiable algebraic 
forms. In the following section, we employ an affine 
approximation method to convexify the t\ -RLQ problem. 
Then, we use our results to propose an iterative algorithm 
to compute sub-optimal solutions for the original (q-RLQ 
problem. 

Remark 1: Alternative forms of (|-RLQ problem have 
been considered before in [ 2 ], where the authors employ an 
ADMM-based approach to handle nonlinear constraint (|7j. In 
our numerical experiments in Section [vj we will repeatedly 
compare the performance of our proposed algorithm to that 
of [ 2 ], 


where X e §^ + , Y £ S", F £ S”, K £ R mxn and 
p e R raxn . 

Proof: See Appendix. ■ 

In the following proposition, we take an important step 
toward dealing with the nonconvex term 0 in Efi-RLQ 
problem. 

Proposition 1: The E/:j - RLQ problem can be relaxed as: 


Relaxed E4-RLQ Problem (RE^-RLQ): 


Minimize Tr(X) +ai||/\'L, 

X,K,F,P,Y 

subject to: 

f-O - F + Y 2X - P 1 


2X - P 
P 

A + BK 


P = X- 

2 

x A ei I, 

h 0 , 
to, 

Y-(1 + S)P t P\\ 


Y 

pT 1 

P 


F 

K t ' 

K 

R- 1 


< e, 


P T ‘ 
0 


to, 


( 10 ) 


IIL SDP-Restriction of the RE4-RLQ Problem 

In this section, we derive a SDP-restriction of a relaxed 
form of / ] - RLQ problem. In the first step using the following 
lemma, we rewrite t\ - RLQ problem in a new equivalent 
form where the source of nonlinearity in l\ - RLQ problem 
is extracted and isolated as a new constraint, i.e., inequality 
0. Then, we will show how to utilize affine approximations 
to estimate that nonlinear constraint and come up with a 
SDP-restriction of a relaxed form of fi-RLQ problem. Let 
us denote 8” + and 8™ to be the positive definite cone and 
positive semi-definite cone of n x n matrices, respectively. 

Lemma 1: The fi-RLQ problem is equivalent to the 
following optimization problem: 


Equivalent Form of the fi-RLQ Problem (Efi-RLQ): 


Minimize Tr(X) + ai||/CL, 
X,K,F,P,Y 

subject to: 

1*0 — F + Y 2 X - P T 
2 X-P I 

P 0 

X h er/, 


to, 
to, 

Y A (1 + 6)P T P, 


Y 

pT 1 

P 

r ^ 7 

F 

I< T ~ 

K 

R- 1 


P T ‘ 
0 

10 


to, 


(9) 


where ||.||* denotes the nuclear norm of (.) which is defined 
as sum of singular values of (.). And also for a given matrix 
U, we have ||[/||* = Tr(VU T U) where \/U T U is a matrix 
for which we have U T U = (VU T U) 2 . 

Proof: Our goal is to prove that RE/ 1 - RLQ problem 
is a relaxation of Efi-RLQ problem. It suffices to show that 
the feasible set of REQ-RLQ problem, which is represented 
by F \, contains the feasible set of E£| - RLQ problem, which 
is represented by F-i. Moreover, suppose that X { denotes 
the set of all feasible points specified by all constraints of 
RE(| -RLQ problem except constraint ( |T0| and T,\ denotes 
the set of all feasible points determined only by constraint 
©■ It is straightforward to verify that Fo (= X 3 . This 
is because the set of constraints specifying X 3 is a subset 
of set of constraints specifying F>- This implies that for 
a feasible point (Xi, K\, Fi, P\, Yf) £ X 2 , it follows that 
(X,J<- u F- [ J\.Y ] )eF :i . 

Since (X 1 ,K 1 ,F 1 ,P 1 ,Y 1 ) £ X 2 , Tj = (1 + 6)PfP t 
is satisfied. Therefore, ||Yi — (1 + S)Pf T’l ||* = 0 is also 
satisfied and consequently ||Yi — (1 + <5)70Pi ||* = 0 < e 
is also tme. Thus, (X 1; Ej, P 1; Yj) £ T,\. Considering 
the fact that D X 4 = T\ is satisfied, it implies that 
(X-|, K[ , F\ , P], Y-] ) £ F\ . Thus, it proves our claim that 

T\ 3 F 2 . ■ 

Remark 2: It should be noted that there is no much 
difference between choice of ||.||* and ||.|| in ( [T()| . It just 
affects the choice of parameter e. 

In the following step, we employ a real analysis idea [25] 
to convexify the right hand side of inequality ( [T()| in RE/ i - 
RLQ problem, which is the only nonconvex term appearing 
in RE( | -RLQ problem. By performing some matrix calculus. 























we calculate the convex affine approximation of M = (1 + 
S)P T P as follows 

TV = (1 + 5)(P T P + P T (P- P)), 

where P is an estimate of P. We refer to [22] for more 
details on affine approximations of functions of matrices. 

So, we substitute the nonconvex condition ||Y — M||* < e 
with convex condition ||Y — TV|| < - where ||.j| denotes 
operator norm which is defined as largest singular value of 
(.). Finally, using the proof of proposition 2.1. in [26], we 
get the following proposition: 

Proposition 2: The REG -RLQ problem can 
be restricted as the following SDP form: 


SDP Restriction of the REf^-RLQ Problem (SDP-R- 

RE4-RLQ): 


Minimize Tr(X) + a\\\K |L. 

X,K,F,P,Y 

subject to: 

~-Q -F + Y 2 X-P T 
2 X - P I 

P 0 

A + BK 


P = X - 
X h eiJ, 


2 

to, 

t°, 

-I Y-N 

n 

Y-N 


Y 

P T 1 

P 

sh 1 . 

F 

K t ' 

K 

R ~ 1 


>- 0. 


P T ' 
0 

K 


to, 


Proof: Let us suppose that Fg denotes the set specified 
by constraint ||Y — TV|| < ^ and Jg = J 3 fl Fg. 

So, we should prove that Fg C F\. Suppose that 
(X- 2 , K‘ 2 , P 2 , P‘ 2 ■ Y‘ 2 ) be a feasible point in Fg. Hence, we 
have (X 2 , K 2 , F- 2 , P 2 , Yf) £ F 3 and (X 2 , At, F 2 . Pi-, Yf) £ 
Fg. Using the fact indicated in inequality (2.1) in [26], we 
have ||Y — TV||* < n||Y — N\\ < e. Also, it is easy to 
check that M — N = (S + 1 )(P — P) T (P — P) is satisfied. 
Thus, together with Y f M, it implies that Y f Alf N. 
Now, Y - M A Y — N and (Y — N) — (Y — M) = 
M - N Y0 implies that Tr(Y — TV) — Tr(Y - M) > 0. 
Since Y — M and Y — N are both symmetric matrices, 
their traces are same as their nuclear norms. Hence, we will 
have ||Y - M||* < ||Y - TV||*. Thus, ||Y - M||, < e 
and subsequently (X 2 , K 2 , F 2 , P 2 , Y 2 ) £ F 4 are resulted. 
Consequently, (X 2 , K 2 , F 2 , P 2 , Y 2 ) £ F,\ n F :i = F\. 
Subsequently, Fg C F\ is satisfied and proof is done. ■ 
Remark 3: In the following, we try to explain the existing 
technical issue with the method proposed by [4]. In problem 
(RLX) in [4], very briefly, the authors have considered the 
Y — TV as difference of two positive semi-definite matrices 
Z + and Z_ and forced trace of Z + to zero by minimizing 
some multiplier of it in objective function, then they have 


made a conclusion that Y — TV becomes negative semi- 
definite and this together with Y Y X~ [ forces Y = X~ l . 
We know that Y A TV,thus Y — TV cannot be negative semi- 
definite. We are just able to minimize ||Y — TV||. The point 
is that when we force trace of Z + to zero, it cannot be 
necessarily implied that Z + — Z_ tends to — Z_ and so it 
is negative semi-definite. Because, X_ is an optimization 
variable and its trace can be either tend to zero and if the 
rate of tending be greater than of Y + one, — Z_ cannot 
be negative semi-definite. Also, if we run algorithm proposed 
by [4], we will see that not only Z+ — is not negative 
semi-definite, but also it is positive semi-definite which 
is previously theoretically guaranteed.Thus, we minimize 
|| Y — TV|| instead of using such a method presented in [4], 

Remark 4: The other point is that we have characterized 
the approximated constraint via some parameter called e in 
feasible set. However, authors in [4], has done such a goal by 
considering some parameter called a 2 in objective function. 
Although, these two approaches are equivalent by ignoring 
the issue arisen in Z + — Y_, our proposed method gives 
much better insight. Because, in proposition [2] we show how 
||Y — TV11 and ||Y — M\\ are related to each other. 

We consider the SDP-R-REfi-RLQ problem and solve 
it iteratively by using CVX toolbox. The procedure is as 
follows: 

Firstly, we start to solve the SDP-R-RE/ j -RLQ problem 
for initial guess P°. Then, at each step we update the previ¬ 
ous values of P by its current computed value and continue 
this process until we reach to the desired level of accuracy. 
It should be mentioned that the parameter e is firstly chosen 
as a sufficiently large number to find a primitive solution and 
then it decreases in a geometric progression form in order to 
achieve the sub-optimal solution. In section IV we propose 
and discuss such an algorithm in detail. 


IV. An Iterative Algorithm to Solve for 
Sub-optimal Sparse Solutions 

In order to compute a near-optimal sparse feedback 
controller, we propose an iterative algorithm which works 
based on solving a sequence of SDP forms [27]. The 
abstract notion of our proposed algorithm is as follows: 


1) Given a > 0, /3 < 1, e 2 > 0, P := P°. 


2) For i=l,2,... do 

3) Set e := na/3* -1 


4) Solve SDP-R-REfi-RLQ problem to find optimal P*. 


^ Tf ll p *--P||r > , nr ||V-U+1)P* 

-u If IIP* II ^ — e 2 01 || VII r. 


> 62 then, set 


||P*|| F - - ||y|| 

P equal to optimal P*, else, set P opt = P* break 


6) End for. 


where ||.||f denotes the Frobenius norm of (.) which is 
defined as ||.||f = v^’COFO))- 

Our selection of Frobenius norm doesn’t provide any 
major advantage and it can be replaced by operator norm or 
nuclear norm [23], It should be considered that P° is initiated 


















as A' 0 — a+ 2 k where (K°) is the solution of standard 
LQR problem and A 0 is equal to / 0 °° e^ A+BK °" >Tt (Q + 
K° T RK°)e( A+BK °^ t dt which can be computed via solving 
a Lyapunov equation. The inequality appeared on item [5] of 
the proposed algorithm are considered in a normalized form 
to reach higher accuracy. 

As we will see in section [V] our numerous experiments 
show that our proposed algorithm converges and suggests a 
sub-optimal sparse solution for t\ -RLQ problem, however, 
we have no proof on its convergence. 

V. Numerical Experiments 
A. Spatially Decaying Systems 

Here we give an example of spatially decaying systems 
which have been considered in [28], [12], [13], [14]. In such 
systems the absolute value of entries of ,4-matrix decreases 
spatially, i.e. when we start from an entry on main diagonal 
and get away from it, the absolute value of entries falls off. 

As a sub-class of such spatially decaying systems, let us 
consider the sub-exponentially decaying systems. The ij th 
element of a random sub-exponentially decaying system 
A is defined by A i: j = Cie~°‘ A ^~^ A where c* is the real 
random number corresponded to the i th row and generated 
by randn command of MATLAB, a a is a positive real 
number and [3a is a real number between 0 and 1 [29]. Note 
that a a determines the width of the band of the matrix A 
and [3a specifies the rate of decaying in sub-exponentially 
decaying system modeled by A. For large values of a a we 
get narrow band width and for large values of [3 we get 
high rate of spatially decaying. Since we have An = Ci , c,; 
appears on i th entry of main diagonal of matrix A. By taking 
a a = 5, [3 a = 0.5077 and some randomly generated c^’s 
we get the following sub-exponentially decaying .4-matrix: 


'0.5377 

0.0036 

0.0004 

0.0001 

0.0000 

0.0000' 

0.0124 

1.8339 

0.0124 

0.0015 

0.0003 

0.0001 

-0.0018 

-0.0152 

-2.2588 

-0.0152 

-0.0018 

-0.0004 

0.0001 

0.0007 

0.0058 

0.8622 

0.0058 

0.0007 

0.0000 

0.0001 

0.0003 

0.0021 

0.3188 

0.0021 

- 0.0000 

-0.0001 

-0.0002 

-0.0011 

-0.0088 

-1.3077 

set 

of 

eigenvalues 

of 

A 


{-2.2588,1.8339, -1.3077,0.5376,0.8622,0.3187}. 

Thus, A is an unstable system. Assuming the u\ = 0.005, 
a = 0.00001, [3 = 0.99, S = 0.001, n = 0.000001, 
£2 = 0.00005 and B = Q = R = I, Algorithm in section 
IV proposes the following sub-optimal sparse state feedback 
gain controller: 


" 1.6675 

-0.0066 

0.0000 

0.0000 

0.0000 

0.0000" 

-0.0113 

-3.9123 

0.0000 

0.0000 

0.0000 

0.0000 

0.0000 

0.0000 

-0.1992 

0.0000 

0.0000 

0.0000 

0.0000 

0.0000 

0.0000 

-2.1760 

-0.0014 

0.0000 

0.0000 

0.0000 

0.0000 

-0.0001 

-1.3632 

0.0000 

0.0000 

0.0000 

0.0000 

0.0000 

0.0000 

-0.3304 


The set of eigenvalues of A + BK opt consists of —2.4575, 
-2.0789, -1.1298, -1.0444, -1.3139 and -1.6380. Thus, 
the proposed sub-optimal sparse feedback gain controller is 
stabilizing. Also, the optimal value is 9.6968. The optimal 
value of the standard LQR problem is 9.6965 in this case. 


In a similar way, we consider a 16 x 16 sub-exponentially 
decaying system and plot its corresponding matrices A and 
K in a logarithmic gray-scale spectrum. The corresponding 
parameters are as follows: 

ai = 0.005, a = 0.00001, /3 = 0.99, = 5, 

[3 A = 0.8903, 5 = 0.001, a = 0.000001, e 2 = 0.00005 and 
B = Q = R = I. The logarithmic gray-scale spectrum of 
matrices A and K opt has been depicted in Fig. [I] and Fig. 
[2] respectively. 



'H_._,_ 
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Fig. 1. Logarithmic gray-scale spectrum of matrix A 



Fig. 2. Logarithmic gray-scale spectrum of matrix K opt 

As it is depicted in Fig. [2] the sub-optimal sparse state 
feedback gain controller K opt has a sub-exponentially-like 
structure. In [30], it has been shown that if matrices A, 
B, Q and R belong to an operator algebra structure, the 
corresponding standard LQR problem solution inherits such 
a structure. So, here we see some similar intuitive observation 
which illustrates such a fact. 

B. Cyclic Systems 

Here, we consider cyclic systems to investigate our pro¬ 
posed algorithm in section IV. Cyclic systems arise in various 
applications such as biochemical reactions which have been 
widely studied from mathematical point of view in different 
works such as [16], [17], [18], [19], [20], [21], The A- 
matrix of a cyclic system is specified satisfying the following 
properties: 













• An is negative for all i £ {1, 

• is positive for all i £ {2, 

• Ai n is negative. 

Let us assume that A is a 10 x 10 random cyclic matrix 
generated by MATLAB. Then, the sparsity pattern of sparse 
state feedback gain controller for such a system with fol¬ 
lowing parameters: a\ = 0.5, a = 0.00001, /3 = 0.99, 
S = 0.001, ei = 0.000001, e 2 = 0.00005, B = Q = R = I 
has been depicted in Fig. [3] As it is pointed in Fig. [3] the 



nz = 18 


Fig. 3. Sparsity pattern of matrix K opt for ai =0.5 


number of nonzero terms of the proposed sub-optimal state 
feedback gain controller is equal to 18 i.e. 82% of entries 
of the proposed sub-optimal state feedback gain controller 
K opt is equal to 0. Thus, it is sparse. Also, the optimal 
value of the standard LQR and optimal value of our proposed 
sub-optimal state feedback gain controller are 16.3760 and 
17.8602 respectively. So, for a\ = 0.5, if the quadratic cost 
gets increased by 9.06%, the sparsity is improved by 82%. 

Table [I] demonstrates the effect of penalizing parameter 
■a:] on optimal value J opt and cardinality of sub-optimal 
controller \\K opt \\ (ia in our proposed method (i.e. CVX) 
and the method proposed by [2] (i.e. ADMM). Based on 
data set shown in Table 0 Fig. 0 depicts how penalizing 
parameter, sparsity level and performance degradation relate 
to each other. As it is seen intuitively. Fig. [4] confirms 
this fact that as penalizing parameter a\ increases, the 
sparsity level decreases, however, performance degradation 
increases. Thus, there is a trade-off between sparsity level 
and performance degradation. As an instance for a | = 0.1, 
by increasing 1.17% and 1.12% in quadratic cost for CVX 
and ADMM, respectively, 73% and 72% of sub-optimal 
sparse state feedback gain controller entries get equal to 0, 
respectively. 

According to the secant condition stated in [17] for the 
stability of the linear cyclic systems, we have the following 
sufficient condition: 


- / ; - < sec — 

IL=i(-^«) n 


where by superscript c , we mean the closed loop. 
By doing some basic math, it yields that we have: 


TABLE I 

QUADRATIC COST AND CARDINALITY VS PENALIZING PARAMETER FOR 
OUR PROPOSED METHOD AND THE METHOD PROPOSED BY [2] FOR A 
10 X 10 RANDOM CYCLIC MATRIX. 


jlqh = !6.3760 and \\K L< ^ H \\ lo = 

100 

log 

scale 

CVX 

CVX 

ADMM 

ADMM 

«i 

J opt 

ll^ opt lk 

J opt 

\\K opt \U 0 

0.001 

16.3761 

61 

16.3760 

94 

0.002 

16.3762 

56 

16.3760 

64 

0.003 

16.3765 

55 

16.3761 

58 

0.004 

16.3768 

55 

16.3763 

57 

0.005 

16.3773 

54 

16.3765 

55 

0.006 

16.3778 

52 

16.3768 

54 

0.007 

16.3784 

48 

16.3772 

51 

0.008 

16.3790 

47 

16.3777 

48 

0.009 

16.3797 

47 

16.3782 

48 

0.01 

16.3805 

45 

16.3789 

46 

0.02 

16.3914 

40 

16.3875 

40 

0.03 

16.4070 

38 

16.4020 

39 

0.04 

16.4260 

37 

16.4198 

38 

0.05 

16.4451 

35 

16.4389 

35 

0.06 

16.4663 

32 

16.4590 

32 

0.07 

16.4896 

31 

16.4812 

31 

0.08 

16.5152 

30 

16.5057 

30 

0.09 

16.5422 

28 

16.5318 

28 

0.1 

16.5677 

27 

16.5597 

28 

0.2 

16.8308 

22 

16.7944 

22 

0.3 

17.1527 

20 

17.1126 

21 

0.4 

17.4952 

19 

17.4584 

19 

0.5 

17.8602 

18 

17.8118 

18 

0.6 

18.2200 

15 

18.1611 

15 

0.7 

18.5817 

15 

18.5123 

15 

0.8 

18.9483 

15 

18.8688 

15 

0.9 

19.3169 

15 

19.2274 

15 

1 

19.6853 

14 

19.5860 

14 

2 

23.1799 

13 

22.9991 

13 

3 

25.5533 

13 

26.0798 

13 

4 

26.9975 

12 

28.8795 

12 

5 

28.6990 

11 

31.3772 

10 

6 

30.1690 

11 

33.6764 

10 

7 

31.5150 

10 

35.8389 

10 

8 

32.9970 

10 

37.8935 

10 

9 

34.4342 

10 

39.8488 

10 

10 

35.2497 

10 

41.7020 

10 


1) For Kjj where j £ {l,...,n}, we get the following 
condition: 

„ (cos(^)) n (n” =2 (^i(i-i)))(-^m) 4 

jj < FT” (-A ■) jj ' 

2) For Kj(j_ i) where j £ {2,..., n}, we get the following 
condition: 

— At’O'-i) < Kj(j- i), 
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Fig. 4. The Performance Degradation —— jlqr - x 100 % vs Penalizing 

II || £ 

Parameter ai. The Sparsity Level ^ k lqr^° x 100 % vs Penalizing 

jopt _ 7 LQR 

Parameter ai and The Performance Degradation —— jlqu - x 100 % 

vs Sparsity Level ^ kL qr y" X 100 % corresponded to data set shown in 
Table 0 for both CVX and ADMM methods. 


ber of nonzero entries of state feedback gain controller is 
decreasing. And also, the optimal value is increasing. Thus, 
there is a fundamental trade-off between sparsity level and 
performance degradation. An advantage of our proposed 
method is that just like algorithm 1 in [4], it can be solved 
by using CVX toolbox because of its convex SDP form. 
Although sparsifying rate of our proposed method for small 
values of a\ is higher compared to the proposed method in 
[2], the quadratic cost minimizing rate of the latter one is 
higher than ours. For large values of a±, such a behavior 
is getting reversed. Our proposed method is slower than the 
method presented in [2], however, it has a simpler form. 
Again, we insist on this point that the quadratic cost achieved 
by our proposed method is an upper bound for the exact 
optimal solution of the Sparsity-promoting LQR problem. 

The improvement of the accuracy of our proposed method 
can be considered as a future work. Also, using the norms 
other than l \ -norm or utilizing the weighted version of the 
^i-norm could result in better achievements. We try to use 
the Affine Approximation method as an appropriate tool in 
sparsity problems for which the sparsification occurs in time 
domain. 


Appendix 

The lemma [I] is proved by using the following equivalent 
problems: 


t) < 


(sec(^)rnr=i(-Ai) , 


3) For Ki n , we get the following condition: 


Kin ^ 


■A-in ^ Kin 5 

(sec(^))"niLi(-^) 

(n;u(A: (l -i))) 


In our special case, one of the above 2 n conditions im¬ 
plies that the matrix with one nonzero term K( io)(io) = 
—9577.1955 is one of the sparsest solutions. However, its 
corresponding quadratic cost is 10182.2224 which is an 
extremely large number. In other words, such a solution 
gives an upper bound for the sparse solution corresponded 
to the extremely large value of a.\ which is equivalent to the 
minimizing of ||iv ||^ 0 . It is very interesting that the sparsity 
level for both CVX and ADMM is equal to 10%, however, it 
is equal to 1% for our previously mentioned cyclic system. 


Minimize Tr(X) + aJlXlL.. 
x K 

subject to: 

(.A + BK) t X + X (A + BI\) +Q + K T RK = 0, 
X A 0. (11) 

Minimize Tr(X) + a'i||Ar||^ 1 
subject to: 

[A + BI<fX + X(A + BK) +Q + K T RK A 0, 
X y 0. (12) 

Minimize Tr(X) + ai||.Kj|^ 1 
X,K,F 

subject to: 

(A + BK) t X + X(A + BI<) + Q + F A 0, 

X A 0, 

F y I< t RK. (13) 


VI. Discussion and Conclusion 

As it is shown, we propose a sub-optimal sparsity- 
promoting state feedback gain controller on the basis of 
affine approximation, Schur complement and SDP form. The 
numerical experiments show that our proposed method gives 
an appropriate approximation of optimal sparse solution of 
the £o-regularized LQR problem. For a-| = 0 we get the 
standard LQR solution and by increasing it, we achieve 
more sparse state feedback gain controllers and the num- 


Minimize Tr(X) + a\ IIXL, 

X,K,F 

subject to: 


-Q-Fy 

( A+BK) t 


X y 0, 

F K T ' 
K R- 1 


y o. 


x- 


(A+BK ) 1 
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o' 



o 

-/ 



A+BK 
X — A + BK 
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(14) 





























Minimize Tr(A') + ailliTL.. 

X,K,F,P 

subject to: 

-Q-F + [2X - P T P T ] 


y 


[2X - P T P T 

p=x~ a ± bk 


0 0 
0 ( 5+1)1 


2X - P T ' 
P 


I 0 
0 SI 


2X - P 
P 


form in order to be applied to CVX. Also, in problem ( [T6| , 
Y = (5 + 1 )P T P has been bifurcated to Y A (5 + 1 )P r P 
and Y A (S+1)P T P where the Schur complement is applied 
to the first one to get the problem O- We can do such a 
bifurcation. Because, they are equivalent conditions. 
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The proof procedure from problem (111 to problem ( [14} 
is same as one which has been stated in [4]. We apply 
Schur Complement to problems (13 i and ( fi~6j ) to achieve 
an SDP form in problems ( fi~4| ) and (17 1 respectively which 
makes them applicable to CVX. Although the first Schur 
complement is applied easily, some operations must be done 
during the problems ([14} to ( [16} to apply the second Schur 

complement to part ( | 16[ ) to get problem 113- 
In problem dT6} we substitute X y 0 by A A e \ / to 
get problem ( |17[ ) where 6 \ is sufficiently small number. 
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